In this research, we present an innovative, parameter-efficient model that utilizes the attention U-Net architecture for the automatic detection and eradication of non-speech vocal sounds, specifically breath sounds, in vocal recordings. This task is of paramount importance in the field of sound engineering, despite being relatively under-explored. The conventional manual process for detecting and eliminating these sounds requires significant expertise and is extremely time-intensive. Existing automated detection and removal methods often fall short in terms of efficiency and precision. Our proposed model addresses these limitations by offering a streamlined process and superior accuracy, achieved through the application of advanced deep learning techniques. A unique dataset, derived from Device and Produced Speech (DAPS), was employed for this purpose. The training phase of the model emphasizes a log spectrogram and integrates an early stopping mechanism to prevent overfitting. Our model not only conserves precious time for sound engineers but also enhances the quality and consistency of audio production. This constitutes a significant breakthrough, as evidenced by its comparative efficiency, necessitating only 1.9M parameters and a training duration of 3.2 hours - markedly less than the top-performing models in this domain. The model is capable of generating identical outputs as previous models with drastically improved precision, making it an optimal choice.

Word embeddings are the vector representation of words which act as an input (features) to other downstream tasks and ML models. There are several popular methods for learning word embeddings; among them, the Continous-Bag-of-Words and Glove models are the two most popular techniques. These embeddings act as an input to several NLP applications, i.e. sentiment analysis, document clustering, question answering, paraphrase detection, etc. Large organizations like Google and Facebook have trained these models on large web-scale corpora and made them readily available. Word embeddings encode the words such that words with similar meanings lie close to each other in the embedding space.